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We present a method by which cosmological perturbations can be quantitatively studied in single 
and multi-field inflationary models beyond linear perturbation theory. A non-linear generalization of 
the gauge-invariant Sasaki-Mukhanov variables is used in a long-wavelength approximation. These 
generalized variables remain invariant under time slicing changes on long wavelengths. The equations 
they obey are relatively simple and can be formulated for a number of time slicing choices. Initial 
conditions are set after horizon crossing and the subsequent evolution is fully non-linear. We briefly 
discuss how these methods can be implemented numerically to the study of non-Gaussian signatures 
from specific inflationary models. 

I. INTRODUCTION 

Our current understanding of the universe on large scales inevitably leads to questions regarding its earliest moments. 
The patterns seen in the distribution of matter on such scales and the fluctuations in the temperature of the CMB, 
point to mechanisms in the early universe that could have imprinted the initial conditions for such patterns on 
the otherwise homogeneous primordial universe. Recent data on CMB anisotropics leave no doubt that initial 
fluctuations existed on scales much larger than the causal horizon at the time of recombination. Inflation is a 
concept which can explain the origin of such fluctuations as well as many other special features of the cosmos. 

Even though the inflationary paradigm has been developing for over twenty years now, there is currently no agreed 
upon model of the inflationary epoch. Almost all models of inflation invoke one or more scalar fields to drive an initial 
phase of accelerated expansion. The latter is capable of producing fluctuations in the energy density by amplifying 
the quantum fluctuations of any light scalar field present during inflation. These fluctuations are usually represented 
as linearized deviations from a homogeneous evolution and are therefore described by non-interacting quantum fields 
living in the expanding spacctimc. Linearity along with the additional assumption that the initial state is the vacuum 
(as defined on scales much smaller then the Hubble radius), lead to the prediction that inflation creates Gaussian 
fluctuations. 1 The smallness of the observed CMB anisotropy certainly justifies the use of linear perturbation theory 
as a first approximation. However, some non-linearity will always be present in inflation due to the non-linear nature 
of gravity and the fact that the potential responsible for inflation may be interacting. Another property that is 
usually attributed to inflation is that it produces adiabatic fluctuations. This is strictly true only for single-field 
models. When more scalar fields are present, there is also a possibility for isocurvature perturbations. It has been 
suggested in the past that the interplay of isocurvature perturbations and non-linearity can lead to enhancement of 
the non-Gaussianity of primordial fluctuations. Reference [f| is an example of this; the curvaton paradigm [|| provides 
another possibility [7j. 

In this paper we present a method for studying the evolution of perturbations in an arbitrary scalar-field-driven 
inflationary model. The equations are valid in the long wavelength regime (scales larger than the Hubble radius) and 
allow for the calculation of non-linear effects. Scalar metric perturbations are taken into account and the scheme 
can in principle be formulated with an arbitrary time slicing. However, we find the use of a particular choice of 
time more convenient. The main variables of this formalism are non-perturbative generalizations of the useful Sasaki- 
Mukhanov variables of linear theory and are invariant under time slicing changes on long wavelengths; one can say 
that they are gauge invariant beyond perturbation theory. Initial conditions are provided after horizon crossing from 
linear perturbation theory. We argue that this is enough and any observable non-linearity will be produced by the 
subsequent evolution. 

The outline of the paper is as follows: In section 2 we provide a framework for the analysis of the long-wavelength 



In contrast, topological defects cannot be described as a smooth linear deviation from a homogeneous background and hence are 
intrinsically non-Gaussian. 
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dynamics for a general inhomogeneous inflationary model. The approach goes beyond perturbation theory and allows 
for a treatment of all possible non-linearities. It is technically much simpler than higher order perturbation approaches 
8]. In section 3 we supplement the long- wavelength equations by stochastic terms which set the initial conditions 
after horizon crossing. Although formulated for a general time slicing, we find that a particular choice of time is most 
convenient. In section 4 we discuss progress towards a numerical implementation of these methods and the future 
prospects. 



II. LONG WAVELENGTH DYNAMICS 

A key characteristic of the inflationary era is the behaviour of the comoving Hubble radius (aH) 1 which shrinks 
quasi-exponentially. This behaviour is unlike what happens during the radiation and matter eras where this scale 
grows. This feature allows inflation to answer a number of puzzling facts about the universe and also provides a 
mechanism for the quantum generation of fluctuations 0, 0] . All of the astrophysically relevant scales start their lives 
subhorizon but eventually they are stretched to superhorizon sizes. In this paper we will focus on the superhorizon 
regime. Hence, a long-wavelength approximation along with a way to set initial conditions suffices for our purposes. 
The long-wavelength approximation we employ consists of dropping from the equations all terms containing second 
order spatial gradients j^, ITol ITlj . Then, spacetime can be described by the metric 2 

ds 2 = -N 2 (t,x)dt 2 + a 2 (t,x)h i:j (x)dx l dx j , (1) 

where N is the lapse function, a is a local scale factor and hij is a local spatial metric with unit determinant. In 
linear perturbation language, the latter contains one scalar degree of freedom (d.o.f), which enters as a second order 
spatial gradient and hence can be ignored, vector and tensor d.o.f's. It can be shown quite generally that hij freezes 
on superhorizon scales The local scale factor a contains the other scalar d.o.f that carries the dynamics on these 
scales. N can be chosen freely and corresponds to a choice of time slicing. 

It turns out that under the above long-wavelength approximation the equations of motion are reduced to those of a 
homogeneous Friedmann-Lemaitre-Robertson- Walker (FLRW) cosmology, applied locally, plus a gradient constraint 
linking spatial gradients in matter and geometry. Hence, each point evolves as an independent universe with its 
own value for the matter fields, Hubble rate and scale factor, provided initial conditions which satisfy the gradient 
constraint have been specified |9l In particular, after dropping a decaying mode |3. Ill|. the evolution equations 
become 

^ = -3Nh(e + Is] , (3) 

and are supplemented by two constraints 



dt V 3 



H 2 = ^r£, d i H=^J i . (4) 

Here, matter is described by the energy momentum tensor T^ v . We have defined the energy density, momentum 
density and stress tensor 

E =N- 2 T 00 , Ji = -N^Toi , Sij = Tij , (5) 

and the local expansion rate 

A vertical bar denotes a covariant derivative with respect to the spatial metric. The above system is consistent only 
* - — I 



if S l j = hSSj which is expected to be true on long wavelengths. 



2 We restrict attention to metrics with zero shift TV; = 
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We now focus on an inflationary era driven by n scalar fields with the energy momentum tensor 



Tpv = G AB d^ A d^ B ~ 9fiv l^G AB d x A d x <f> B + Vj , (7) 
so that 

£ ~ ^G AB Il A U B + V{<t>) , (8) 

Ji = -G AB W A d^ B , (9) 

Sij c~ a 2 h l3 (^G AB n A U B - V s ) , (10) 

where the approximate equality indicates second order spatial gradients dropped. We defined the field momentum as 

n* = £. (ii) 

Then, the long-wavelength equations of motion for this system are 

dH _ 4tt 
~dt 

V t U A = —3NHU A — NG AB V B , (13) 



2 An B n a , (12) 



'pi 

d,H = T H B dicj> B , (15) 

m pl 

where V B = d B V and the symbol T> t appearing in l|13|l will be defined shortly. Note that we have taken a general 
field metric G AB and all the equations below will be valid for such an arbitrary metric. We thus view the dynamics 
as taking place on a general n-dimensional field manifold where 4> A are just a set of n functions parameterizing it. 
Hence, it makes sence to define covariant derivatives when considering the spatial or temporal dependence of various 
quantities. For a spacetime dependent quantity L A (t,x) which transforms as a vector in field space, we define the 
covariant derivatives 

V t L A = d t L A +r A . c d t (l> B L c , V i L A = d i L A + r A c d i (j> B L c , (16) 

with the symmetric connection formed from G AB . The quantities di<p B and NIl B transform as vectors in field 
space but 4> B does not. 

As mentioned above, the system of eqs (|12fl - (I14f) is exactly the same as the equations of FLRW cosmology applied 
locally. However, equation (|15(l gives an additional constraint which is obviously absent in the homogeneous case. If 
one drops the n 2 term from the Friedmann equation l|14H and the T> t Tl A term from eq (|13l) . eqs (|14|l and H15|) are 
equivalent. This assumption is implicit in the "separate universe" picture of non-linear evolution which is a simple 
way to view the long wavelength dynamics (see eg. and references therein). However, in the case of several fields 
certain components of T>t^l A may be important even though slow- roll inflation is still valid |12| . and ignoring them 
may miss the relevant effects. No such assumption needs to be made for the formalism we develop here. 

A natural way to parameterize inhomogeneity beyond perturbation theory is to use spatial gradients of various 
quantities of interest. This is similar in spirit to the approach first advocated in [l3l |. In general, the value of any 
spatial gradient will depend on the chosen time-slicing and by an appropriate choice of time slices the inhomogenous 
part of any spacetime scalar can be made to vanish. However, one can form combinations of spatial gradients, 
including the gradient of the integrated expansion (the local scale factor) , which are invariant under long wavelength 
changes of time slicing. They can be constructed similarly to those of linear perturbation theory. One such variable 
is 

Qt = a fa A - ^X^j , (17) 

with Xi = <9jlna. Such combinations were first introduced in ^l| and it can be checked explicitly that they are 
invariant under t — > T(t, x) transformations on long wavelengths. More recently, such variables were considered by 
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the authors of 14] in a more geometric framework who also showed explicitly that they reproduce previously introduced 
gauge-invariant perturbations at second order. Note that when linearized around a homogeneous background, Q A is 
just the gradient of the well known Sasaki-Mukhanov variable [15J 

6q A = a (V ~ !^*J , (18) 

where ^ = 5a/ a is the perturbation in the trace of the spatial metric. In our notation, the linear version of is just 
di (5a) /a(t) = d^. A similar gauge-invariant variable is [Tl| 

NH 

Ci =Xi~ -g-ftf (19) 

H 

which, using eqs i|15|) and (|17|l . (|19|l can also be written as 

4tt 1 NH„ A 



C* = -5— • (20) 

This is a non-linear generalization of the well known linear curvature variable £. 

The Qi s obey relatively simple equations of motion which can be derived by taking spatial derivatives of equations 
(|12[) - (|14|) and using 1)150. Details of the derivation can be found in Appendix A. It is convenient to define a set 
of slow-roll parameters for the multi-field model (see [12( for a discussion in the framework of linear perturbation 
theory) : 

- A ^ ^ = 1^, (21) 



Nii 2 m^j H 2 ' ' N H n 
which are usually assumed to be much smaller than unity during inflation. 3 It will also be useful to define 

u A = v%. (22) 
Then, the following equations of motion can be derived for the Qf's (see Appendix A) 

V 2 t Q A -(j^-Ni?JV t Q A + n A B Q? = (23) 

with the "mass matrix" 

2 

il A B = N 2 V A B - ^(NH) 2 R a FCB lo f lo c - (NH) 2 [(2 - e) 5 A B + 2 (3 + e) + 2 \/l fea/ + ijVOl , (24) 

47T L 'J 

V b = T>bV a and R A fcb the curvature tensor of the field manifold. These are formally the same equations as those 
of linear perturbation theory for the Sasaki-Mukhanov variables with the k 2 terms dropped ^3] ■ Note that although 
equation (|23|l appears to be linear in the Q A, s, it incorporates the full non- linear dynamics on large scales since its 
coefficients are spatially varying functions. They depend implicitly on the Q^'s via a set of relations which express 
various local quantities in terms of them. Hence, the Q^'s can be seen as master variables encoding all the d.o.f's of 
the inhomogeneous system. Expressing di<p A in terms of Q A , using 1)15(1 and noting that T> t (di4> A ) — T^i (A^II" 4 ), we 
get 

1 

di{]nH) = --(^-) w A Q?-eXi, (25) 
1 I ' m 2 \ 3 

d^ A = -Q A +(^\ u*Xi, (26) 



3 We note here that the following equations, although expressed in terms of the slow roll parameters, are exact, i.e no assumption has 
been made about the smallncss of the latter. 
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and 



1 

aN 



V~ifj A Xi 



(27) 



The right hand sides of Eqs (|25[) - i)27[) are given in terms of gauge invariant variables, apart from the terms involving 
X$. The latter cannot be expressed via a similar relation of the form Xi = JaQ A - For a general choice of time, 125|) 
can also be written as 



Xi = -NHeXi + HdiN - ( 



NH 



(28) 



Note that Xi is not considered as an independent d.o.f. since it is gauge-dependent. All physical d.o.f's describing 
inhomogeneity are encoded in the Q^'s. Hence, a natural choice is to have Xi = if, at all times, Qf — and 
Qf = 0. Such a choice simply means setting Xi{ti n i t ) = initially and making N some function of H, (f> A , IT 4 and 
a. This ensures that djN = /aQ A + 9AQf + hXi with ]a , 9 A and h arbitrary functions. 

The above equations are obviously valid for any choice of N and, as emphasized above, Qf is gauge invariant. 
During inflation however, it is natural to use the logarithm of the local value of the Hubble radius as the time variable 



t = \n(aH) t = J H(l - e)dT , 



with T being proper time. For such a gauge choice we get 

dt 



N- 1 



dT 



= H(l-e). 



Since dit = by definition on surfaces of constant time, we have 

Xi = -di{\nH), 

and H28fl is automatically satisfied. In this gauge the constraints simplify: 



X r = 




uj A Qf = -d z (\nH), 



and 



2W 



a a 



S A C + uj a uj c - V 7 ?' 



~~A u c 
al (1=1) 



Q 



(29) 

(30) 
(31) 

(32) 
(33) 

(34) 



Another advantage of Ij29(l will be discussed in the next section. Equations H32J) - l|34J) specify the gradients of the local 
quantities that appear in the coefficients of ill'- ill in terms of the Q^'s. Note that in this slicing, for quasi-exponential 
expansion, t is monotonic. The validity of such a time variable extends only up to the end of inflation when the 
comoving horizon starts growing again. 

Before closing this section we would like to make one final remark. By taking the time derivative of equation l)15|) 
we can derive the following relation between T> t Q A and Q A 



K A V t Q A =NH[(1 + e) U A + ILfj A ] Q( 



(35) 



Since T>tQf is related to Qf, there is an apparent reduction of order for projections of the perturbations along the 
U A direction in field space. In particular, for the single-field case the full dynamics on long wavelengths can be simply 
written as a first order equation 



d t Qi = NH(l + i + fi) Qi 



(36) 
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From (O we can obtain a non-linear conservation law H3 (see also 0) in the single field case. For 



given that 



C^-l^-) (37) 



< =2xn;[i + fi B ^-) . ( :m 



it straightforward to calculate that is conserved, 

6 = 0. (39) 

III. INITIAL CONDITIONS 

In the previous section we derived a set of equations describing the long wavelength evolution of fully non-linear 
gauge-invariant variables. These equations are exact, as long as the long wavelength approximation we employed is 
valid, and are free of any slow roll assumptions. Of course, one still needs a recipe for providing initial conditions 
for the Q A variables. We propose to use linear theory for calculating their values after horizon crossing. Any further 
non-linearity is introduced via the non-linear evolution. We comment below on whether this is good enough, at least 
for the cases where interesting effects may arise. 

When linearized, the spatial vectors Q A are simply the gradients of the well known Sasaki-Mukhanov variables. 
These are the proper fields to be quantized during inflation [jj 0] and we will assume that they are the appropriate 
variables for setting up initial conditions. One way of proceeding would be to just take 

Q A (t in ,x)=d i 6q A = / — r^= [Q A B(t m ,k)a B (k)tk. ie lk x + c.c] , (40) 
J 27r)2 V 2 
v 

where c.c. stands for the complex conjugate. We have taken a finite region in fc-space, denoted by V, which includes 
the scales of interest and we have defined n constant complex stochastic quantities a A with n being the number 
of scalar fields, A = 1 . . .n. The classical random field exhibits the same correlations as the quantum field if the 
stochastic constants a A satisfy 

A (k)a* B (k'))=6 A B 5(k-k') , (a A (k)a B (k')) =0 (41) 



(or 



where (...) denotes an ensemble average. We have of course implicitly assumed that on long wavelengths quantum 
fields can be considered as classical stochastic fields with the same correlation properties [la. IrH Il8| . The matrix 
Q j4 s(k, t) is the solution to the linear equation of motion 



N „ \ , lfNk\ 2 



V\Q A B " ( ^ " NH j V ^ A b + y [—) sA c + n A cj Q C b = 0. (42) 

The initial conditions for Q A b are in turn set up when the relevant mode is deep inside the horizon ((k/a) 3> H) 
using the properly normalized WKB solutions of l|42(l in that regime 



Q A B (k,t) = ^=exp 
y 2k 



1 Ndt' 



S a b- (43) 



A more dynamic way of setting up the Qf after horizon crossing involves using source terms on the r.h.s. of ill'Mli 
which continuously update the values of Q A as more modes enter the long wavelength system. In this sense these 
sources also set up "initial conditions", albeit in a continuous manner. A heuristic argument for the derivation of 
such ter ms, which is exact at the linear level, is as follows: Start from linear theory and the full equation of motion 
for Sq A [H 



(Nk\ 



2 



VtM ~[ 'N~ NH j Vt ^ + { ~ J 6 c + n c Sq = °- (44) 
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Since we are interested in the long-wavelength semi-classical dynamics, we can coarse-grain Sq A thus defining a long 
wavelength linear field 

5q A (x) = J d 3 x'6q A (x')W fe^) , (45) 

where R is an appropriate smoothing scale and the window function W is normalised to unity 

(2tt)- 3 / 2 J d 3 x'W = 1- (46) 

From the convolution theorem the Fourier transform of Sq A (x) reads 

6q A (k)=6q A (k)W(k), (47) 

where W(fc) is the Fourier transform of the window function W. From l|44|) we can now derive an equation of motion 
for 8q (k). It is easily seen to be 

V 2 t 5q A (k) -\J$- NH J Vt6q A M + n A B Sq B (k) = C A (k), (48) 

with 



C A (k) = Sq A (k)W(k) 



2D t Sq A (\s.) - 1^ - Nh) 6q A (k) 



W(*) - W(fc)<Jg A (k). (49) 



In l|49|) . (5g A (k) refers to the solution of the full linear equation l|44|l with subhorizon initial conditions l|43|) . The real 
space version of (|48|) reads 

V 2 t 5q A (x) -(jf- n hJ Vt6q A (*) + n A B Sq B (x) = J -^I^^V^ + c ^ • (50) 

The gradient of the l.h.s of H50|l is the linear version of (J2HJ). We will therefore postulate that a suitable equation for 
the study of the long wavelength non-linear dynamics of the system with initial conditions provided from subhorizon 
scales by linear theory is 

V]Q A - ( ^- - N H )v t Q A + n A B Q? = [ -^L lfe ^(k) e lkx + c.c, (51) 



N J — J (2tt 

where now all coefficients depend on the full non-linear Q A . Since £ A is stochastic, equation (|51|l is a non-linear 
Langevin equation for the long wavelength system. 

Equation l|51l) is the main result of this section. We can use it along with [lol'li - (|34|) to generate non-linear 
simulations of inflationary perturbations. Note that the choice of time (|29|l has one more advantage when used in 
conjunction with stochastic noise. The scale that separates the long-wavelength from the short-wavelength regime for 
linear perturbations is the comoving Hubble radius. For this reason we will choose our smoothing scale R to be a 
multiple of (aH)^ 1 : 

atl 

with c > 1 ^^ 4 - F° r the gauge choice (|29|l the split between long and short wavelengths is homogeneous throughout 
all of space since aH is homogeneous. For other choices of time parameter, the 'time' when a mode is added to the 
long wavelength system differs from point to point. It seems conceptually more appealing to have the noise added 
simultaneously everywhere and that is exactly what a di \n(aH) = gauge does. The same conclusion for slightly 
different reasons was reached in Ha. 



4 The values c ~ 3 — 5 will do for safely neglecting the k 2 term in 
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The use of linear theory for setting up initial conditions for the Q A i or constructing the noise term completely ignores 
non-linearities from sub-horizon scales for these variables. One might question whether such an approximation misses 
out important effects before and around horizon crossing. Although th is q uestion cannot be answered within the 
framework described above, explicit calculations using this methodology |2Ct l2l) prove that such effects are actually 
unimportant. In the case of both single and multiple- field inflation perturbative calculations at tree level [2^ (see 
also (23 for a consideration of loop effects) show that non-Gaussianity at the time of horizon crossing is suppressed 
by slow-roll factors. This is considered too low to be observable in any future experiment. This result is actually 
reproduced in a simple way using the methods outlined above |2Ct l2l|. However, as shown in |2lj subsequent non- 
linear evolution in certain models can enhance non-Gaussianity, making initial non-linearities subdominant. If this 
non-Gaussianity is observable, the scheme proposed above can safely be used to calculate it. 

IV. DISCUSSION AND FUTURE PROSPECTS 

The system of stochastic inflation equations presented here provides a concrete and self-consistent realization for 
simulating the generation and evolution of perturbations in the long wavelength approximation. The method can be 
applied to arbitrary single or multi-field inflationary models producing both adiabatic and isocurvature fluctuations 
and does not depend on the slow-roll approximation. Moreover, this approach incorporates the nonlinearities inherent 
in the Einstein equations from the point the perturbations leave the cosmological horizon until the end of inflation. 
The method is, therefore, very relevant to the study of non-Gaussianity in inflation, which may prove to be a key 
litmus test of specific realistic models 19j. Indeed, the limits on non-Gaussianity are set to improve substantially over 
the next few years with forthcoming CMB experiments and so this may prove to be an important confrontation with 
observation. An extension of the ideas presented here as well as analytic and numerical approaches for calculating 
this non-Gaussianity will appear in forthcoming publications [2(], 0] ■ 

The aim is to estimate the amount of non-Gaussianity generated and check whether it can be used as a further 
discriminant between models. Since this method can provide the real space non-Gaussian fluctuations, the possibility 
opens up for applying non-Gaussian tests both in real and Fourier space and determining which one is the optimal 
given a particular model. Such simulations therefore would be an important advance towards making quantitative 
predictions for realistic inflation models which can be tested against observational data, notably forthcoming CMB 
experiments. 

Here, we shall only briefly describe the numerical implementation of these methods, leaving a detailed discussion 
for a much longer paper |24| . The development of a large and complex stochastic inflation code is well-advanced 
but is still undergoing rigorous testing in specific cases on a parallel supercomputer (COSMOS). There are basically 
five key stages to the implementation: (i) homogeneous (background) solution, (ii) linear perturbation evolution, (iii) 
stochastic inflation generation and initial nonlinear evolution, (iv) subsequent long wavelength or separate universe 
evolution and, finally, (v) the end of inflation and a determination of the resulting (nongaussian) adiabatic and 
isocurvature fluctuations, corresponding to the initial conditions for standard large-scale structure and CMB analysis. 
Both (i) and (iv) are straightforward and essentially identical, solving l|14|) and (|I3|) . although the separate universe 
evolution is for a large grid of N 3 universes with perturbed initial conditions and so it is computationally intensive. 
Step (ii) entails the solution of the linear mode matrix equations (|42() for a general single or multi-field inflation 
model. The next stage (iii) is the most complex and computationally intensive when we solve for the Qj's in the key 
nonlinear perturbation equations (12- ill while adding stochastic noise from the linear perturbation evolution as in l|51f) . 
At each timestep in this evolution, this entails the iterative correction of the separate universe variables to incorporate 
the new stochastic fluctuations in the Q^s. There are several constraint equations which are monitored to ensure 
that this occurs self-consistently and that the evolution does not drift away from the correct nonlinear solution. This 
expensive evolution is only undertaken while the window function for the stochastic evolution is such that significant 
new fluctuations are being added to the numerical grid, before switching to the more efficient separate universe 
evolution (iv). Finally, at the end of inflation (v) we only implement fairly rudimentary 'instantaneous' reheating to 
obtain a set of gauge-invariant perturbations suitable for subsequent perturbation evolution. We are then using the 
final data products of nongaussian adiabatic and isocurvature perturbations as input in a full Boltzmann evolution 
code to create full-sky and high resolution CMB realizations for analysis and comparison with observation [24| . 

We finish by emphasising the key advantages of this new approach to the study of nonlinear inflationary fluctuations, 
while also pointing out areas for further development of these ideas. First, although the discussion of stochastic 
inflation and the separate universe approach now has a substantial history [Trl Hsj . in most previous work it has 
usually been applied to the field perturbation sector without self-consistently solving the constraints for the metric 
perturbations or, in exceptional cases, that has been achieved only for very specific single- field models Here, the 
method has been applied to both field and metric perturbations in generic inflation models with all the constraints 
satisfied in the long wavelength approximation. Secondly, 'generic' includes multi-field models which are believed to 
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be much more likely to produce significant non-Gaussianity; indeed, most recent realistic inflation model-building 
entails several fields. Thirdly, the methods presented here allow for the nonlinear evolution of the perturbations from 
the time at which each mode leaves the horizon. This takes into account the effect of the long wavelength modes 
on the subsequent shorter wavelength noise. Fourthly, unlike previous work, this long wavelength framework allows 
for general choices of time-slicing with the relevant perturbation variables always remaining invariant. Finally, the 
separate universe approach considered here corresponds to the lowest order terms of a gradient expansion of the full 
nonlinear Hamilton- Jacobi equations j25j . This seems to the authors likely to be a more fruitful and elegant approach 
to incorporating further nonlinearity than the technically much more complicated alternative of applying higher order 
perturbation theory to the original Einstein equations Q. Of course, other improvements can be made to the methods 
discussed here, such as including the subdominant effects of vector and tensor modes and a more rigorous justification 
of the quantum noise. Nevertheless, we believe the present work constitutes an important step forward since it enables 
the quantitative calculation of nonlinear effects in generic inflationary models. 
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APPENDIX A: DERIVATION OF EQUATION (f23l) 

In this appendix we outline the derivation of equations ll'-il) . Taking the covariant time derivative of Q A we get 

T> t Qf = NHQf + aVt (ATT 4 ) - ad, (NH) ^ - aX{D t (^j , (Al) 

where we have used that V t (di<fi A ) = T>i (ATI' 4 ). We then take the second time derivative. Most of the calculation 
is straightforward and we will not reproduce it here since it leads to long expressions. We only discuss non trivial 
points. In calculating T>\Q, A we encounter the term T> t T>Jl A . Using the definitions (|16|) we readily see that 

V t V t U A = ViV t U A + NR A FCB U F U c d l (b B 

= V{D t U A + ^R A FCB U F U c Qf. (A2) 
a 

Here, R A fcb is the curvature tensor of the field manifold and in deriving the last equality we used the antisymmetry 
properties of its last two indices. Now we can readily evaluate the ViV t Il A term by taking a covariant spatial derivative 
of so we have 

V t ViU A = -ZNHV t Tl A - 3NU A diH - 3d l NHH A - d t NV A - NV A B d l <j) B + —R a FC b^ F ^ C Q?- (A3) 

a 

We can now replace VJ1 A wherever it occurs by 



T>iU A = —V t 
N 

and substitute diH from 



a J H 



- ^U A m, (A4) 



diH = -^rIl B (-Qf + ^rX t ) . (A5) 



Another term that needs to be dealt with is diH. By differentiating (|12|l we get 



diH = -^rdtNU 2 - ^-NUbV.U 13 . (A6) 
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The second term on the r.h.s can be obtained from the differentiation of (|14|) along with the use of i|15|) . It reads 



Putting everything together and using eq. (|28|l we see that the terms involving X.- L and diN cancel out and we are 
left with eq 
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